Papers with paraphrase generation

49 papers
kNN-BOX: A Unified Framework for Nearest Neighbor Generation (2024.eacl-demo)

Copied to clipboard

Challenge: kNN-BOX enables quick development and visualization for novel generation paradigm . Currently, knn-BOx has provided implementation of seven popular kN-MT variants .
Approach: They propose a framework which decomposes the datastore-augmentation approach into three modules . they apply kNN-BOX to machine translation and three other tasks .
Outcome: The proposed framework decomposes the datastore-augmentation approach into three modules . it provides implementation of seven popular kNN-MT variants, covering research from performance enhancement to efficiency optimization.
Data-Efficient Paraphrase Generation to Bootstrap Intent Classification and Slot Labeling for New Features in Task-Oriented Dialog Systems (2020.coling-industry)

Copied to clipboard

Challenge: a number of dialog systems have been developed to perform tasks with high accuracy on benchmarks, but there is a problem with annotated seed data.
Approach: They propose a model that augments initial seed data by paraphrasing existing utterances automatically.
Outcome: The proposed approach improves intent classification and slot labeling on a public dataset and with a real-world dialog system.
Automatic and Human-AI Interactive Text Generation (with a focus on Text Simplification and Revision) (2024.acl-tutorials)

Copied to clipboard

Challenge: In this tutorial, we focus on text-to-text generation, a class of natural language generation tasks, that takes a piece of text as input and then generates a revision that is improved according to some specific criteria.
Approach: This tutorial focuses on text-to-text generation, a class of natural language generation tasks that takes a piece of text as input and generates a revision that is improved according to some specific criteria.
Outcome: This tutorial focuses on text-to-text generation, a class of natural language generation tasks, that takes a piece of text as input and generates a revision that is improved according to some specificcriteria.
LingConv: An Interactive Toolkit for Controlled Paraphrase Generation with Linguistic Attribute Control (2025.emnlp-demos)

Copied to clipboard

Challenge: LINGCONV is an interactive toolkit for controllable text generation . it allows fine-grained control over 40 specific linguistic attributes spanning lexical, syntactic, and discourse dimensions.
Approach: They propose a toolkit for paraphrase generation that allows finegrained control over 40 specific linguistic attributes.
Outcome: The toolkit is available at https://mohdelgaar-lingconv.hf.space, with a demo video at https:youtu.be/wRBJEJ6EALQ.
Query and Output: Generating Words by Querying Distributed Word Representations for Paraphrase Generation (N18-1)

Copied to clipboard

Challenge: Existing models tend to memorize words instead of learning meaning of words . existing models tend not to model semantic information, resulting in incorrect sentences .
Approach: They propose a novel model that generates words by querying distributed word representations . they evaluate model on two paraphrase-oriented tasks, namely text simplification and short abstractive summarization .
Outcome: The proposed model outperforms the baseline model on two paraphrase-oriented tasks . it achieves state-of-the-art performance on these benchmark datasets .
Edit Distance Based Curriculum Learning for Paraphrase Generation (2021.acl-srw)

Copied to clipboard

Challenge: Existing studies show that curriculum learning improves translation quality on machine translation . paraphrase generation allows a certain level of semantic divergence between source and target .
Approach: They propose to apply curriculum learning to paraphrase generation for the first time . they propose to use edit distance to improve paraphrase quality .
Outcome: The proposed method improves paraphrase generation quality, compared with previous methods . it uses edit distance, which is not possible for previous methods, the authors say .
Transformer and seq2seq model for Paraphrase Generation (D19-56)

Copied to clipboard

Challenge: Existing methods for generating paraphrases fall into one of these broad categories -rule-based, seq2seq, deep generative models and a varied combination.
Approach: They propose a framework that combines transformer and sequence-to-sequence models for better quality of generated paraphrases.
Outcome: The proposed framework improves on two datasets-QUORA and MSCOCO using transformer and sequence-to-sequence models.
Unsupervised Paraphrasing by Simulated Annealing (2020.acl-main)

Copied to clipboard

Challenge: Existing approaches to generate accurate and different-appearing paraphrases require massive parallel samples for training.
Approach: They propose a novel approach that accomplishes Unsupervised Paraphrasing by Simulated Annealing by performing local editing.
Outcome: The proposed approach outperforms existing models in automatic and human evaluations on Quora, Wikianswers, MSCOCO, and Twitter.
Guiding Zero-Shot Paraphrase Generation with Fine-Grained Control Tokens (2023.starsem-1)

Copied to clipboard

Challenge: Sequence-to-sequence paraphrase generation models struggle with the generation of diverse paraphrases.
Approach: They propose a translation-based guided paraphrase generation model that learns useful features for promoting surface form variation in generated paraphrases from cross-lingual parallel data.
Outcome: The proposed model learns useful features for promoting surface form variation in generated paraphrases from cross-lingual parallel data.
ParaNMT-50M: Pushing the Limits of Paraphrastic Sentence Embeddings with Millions of Machine Translations (P18-1)

Copied to clipboard

Challenge: Using neural machine translation, we generate more than 50 million sentential paraphrase pairs from a large parallel corpus.
Approach: They use a dataset of more than 50 million English-English sentential paraphrase pairs to generate them automatically using neural machine translation.
Outcome: The proposed dataset outperforms all supervised systems on every SemEval semantic textual similarity competition and shows how it can be used for paraphrase generation.
Improving Sequence-to-Sequence Pre-training via Sequence Span Rewriting (2021.emnlp-main)

Copied to clipboard

Challenge: Existing text infilling objectives for pretrained language models require self-supervision by masking out tokens or spans in text.
Approach: They propose to extend text infilling to a self-supervised sequence-to-sequence (Seq2Sequen) task.
Outcome: The proposed task improves the model's performance on various natural language generation tasks.
Lost in Translationese? Reducing Translation Effect Using Abstract Meaning Representation (2024.eacl-long)

Copied to clipboard

Challenge: Abstract Meaning Representation (AMR) can be used to reduce translationese in text . if translationeses are not addressed in training or test sets, evaluation scores can be overinflated .
Approach: They propose to use Abstract Meaning Representation (AMR) to reduce translationese in translated texts.
Outcome: The proposed approach outperforms other methods based on machine translation and paraphrase generation.
Multi-task Learning for Paraphrase Generation With Keyword and Part-of-Speech Reconstruction (2022.findings-acl)

Copied to clipboard

Challenge: PGKPR is a deep learning approach to generate paraphrases using key semantics of the source sentence.
Approach: They propose a model with keyword and part-of-speech reconstruction for paraphrase generation using deep learning.
Outcome: The proposed model outperforms comparative models on two commonly-used datasets.
Learning to Selectively Learn for Weakly Supervised Paraphrase Generation with Model-based Reinforcement Learning (2022.naacl-main)

Copied to clipboard

Challenge: Paraphrase generation is an important natural language generation task . however, the effectiveness of paraphrase generation can be limited due to the limited data available.
Approach: They propose a weakly supervised approach to paraphrase generation that leverages reinforcement learning for effective model training with data selection.
Outcome: The proposed model improves the state-of-the-art performance on four weakly supervised paraphrase generation tasks.
Principled Paraphrase Generation with Parallel Corpora (2022.acl-long)

Copied to clipboard

Challenge: a popular method for paraphrase generation is round-trip machine translation (MT).
Approach: They propose a method that formalizes the implicit similarity function and relaxes it by requiring the entire translation distribution to match . they propose MT can be used to generate paraphrases by decoding back to the source without having to generate pivot translations.
Outcome: The proposed approach is more principled and efficient than round-trip machine translation (MT) and offers an adjustable parameter to control the fidelity-diversity trade-off.
ChatGPT to Replace Crowdsourcing of Paraphrases for Intent Classification: Higher Diversity and Comparable Model Robustness (2023.emnlp-main)

Copied to clipboard

Challenge: generative large language models (LLMs) are replacing human workers for some tasks . crowdsourcing has several downsides: 1) the workforce is costly, 2) output quality is difficult to achieve, and 3) there are overheads related to the design and organization of the process.
Approach: They investigate whether ChatGPT-created paraphrases are more diverse and robust . they use a crowdsourcing tool to collect training or validation examples .
Outcome: The proposed models are more diverse and robust than the existing models.
TESS: Text-to-Text Self-Conditioned Simplex Diffusion (2024.eacl-long)

Copied to clipboard

Challenge: Existing models for diffusion generation are expensive and discrete, resulting in a large number of diffusion steps to generate text.
Approach: They propose a text diffusion model that is fully non-autoregressive and employs a new form of self-conditioning and applies the diffusion process on the logit simplex space rather than the learned embedding space.
Outcome: The proposed model outperforms state-of-the-art non-autoregressive models, requires fewer diffusion steps with minimal drop in performance, and is competitive with pretrained autoregressive sequence-to-sequence models.
ConRPG: Paraphrase Generation using Contexts as Regularizer (2021.emnlp-main)

Copied to clipboard

Challenge: Existing methods for paraphrase generation lack reliable supervision signals.
Approach: They propose an unsupervised paradigm for paraphrase generation based on contextual language models, candidate filtering and paraphrase model training based upon the selected candidates.
Outcome: The proposed paradigm outperforms existing paraphrase generation methods in supervised and unsupervised setups.
On the Evaluation Metrics for Paraphrase Generation (2022.emnlp-main)

Copied to clipboard

Challenge: Existing evaluation metrics for paraphrase generation are not designed for the task, but adopted from other evaluation tasks.
Approach: They propose a new evaluation metric for paraphrase generation that uses reference-based and reference-free metrics.
Outcome: The proposed evaluation metric outperforms existing metrics and is more reliable than reference-based metrics.
DivGAN: Towards Diverse Paraphrase Generation via Diversified Generative Adversarial Network (2020.findings-emnlp)

Copied to clipboard

Challenge: Paraphrases refer to texts that convey the same meaning with different expression forms.
Approach: They propose to incorporate a diversity loss term into a deep generative model to generate diverse paraphrases.
Outcome: The proposed model can generate more diverse paraphrases compared with baselines.
Paraphrase Generation and Evaluation on Colloquial-Style Sentences (2020.lrec-1)

Copied to clipboard

Challenge: a new study investigates the quality and novelty of generated paraphrases . paraphrase models can be used for information retrieval and data mining .
Approach: They use state-of-the-art neural machine translation models trained on the Opusparcus corpus to generate paraphrases in six languages.
Outcome: The proposed model outperforms the existing model on human evaluation in five of the six languages.
Learning Semantic Sentence Embeddings using Sequential Pair-wise Discriminator (C18-1)

Copied to clipboard

Challenge: a novel method for obtaining sentence-level embeddings is proposed . the problem of obtaining a semantic embeddable sentence is at the core of understanding languages .
Approach: They propose a method for obtaining sentence-level embeddings by using a sequential encoder-decoder framework.
Outcome: The proposed method outperforms the state-of-the-art on a sentiment analysis task.
Neural Language Taskonomy: Which NLP Tasks are the most Predictive of fMRI Brain Activity? (2022.naacl-main)

Copied to clipboard

Challenge: Existing literature has focused on pretrainer-based text-driven brain encoding models . however, few studies have explored the efficacy of task-specific learning of Transformers .
Approach: They propose to use ten popular natural language processing tasks to learn Transformer representations for predicting brain responses.
Outcome: The proposed model predicts brain activity across the whole brain.
Unsupervised Paraphrasability Prediction for Compound Nominalizations (2022.naacl-main)

Copied to clipboard

Challenge: Nominalizations can be difficult to interpret because of ambiguous semantic relations between deverbal noun and its arguments.
Approach: They propose to over-generate clausal paraphrases to predict whether a prenominal modifier can be re-written as a noun or adverb in a claual paraphrasability.
Outcome: The proposed method improves paraphrasability prediction and paraphrase generation in English . it shows that the prenominal modifier can be re-written as a noun or adverb in a clausal paraphrase .
Exploring Diverse Expressions for Paraphrase Generation (D19-1)

Copied to clipboard

Challenge: Existing neural paraphrase generation methods focus on single paraphrases while ignoring the fact that diversity is essential for enhancing generalization capability and robustness of downstream applications.
Approach: They propose a novel approach with two discriminators and multiple generators to generate a variety of different paraphrases.
Outcome: The proposed model gains significant diversity and improves quality over state-of-the-art datasets.
GCPG: A General Framework for Controllable Paraphrase Generation (2022.findings-acl)

Copied to clipboard

Challenge: Existing studies highlight a special condition under two indispensable aspects of controllable paraphrase generation (CPG) individually, lacking a unified circumstance to explore and analyze their effectiveness.
Approach: They propose a general controllable paraphrase generation framework that integrates lexical and syntactical conditions into a text sequence and uniformly processes them in an encoder-decoder paradigm.
Outcome: The proposed framework can combine lexical and syntactical conditions and improve paraphrase generation.
Tree-Structured Non-Autoregressive Decoding for Sequence-to-Sequence Text Generation (2025.findings-emnlp)

Copied to clipboard

Challenge: Autoregressive Transformers suffer from high inference latency due to sequential token generation.
Approach: They propose a tree-structured non-autoregressive decoding paradigm that bridges autoregressive and non-automatic decoding.
Outcome: The proposed paradigm outperforms autoregressive and non-autoregressive decoding in machine translation and paraphrase generation.
Decomposable Neural Paraphrase Generation (P19-1)

Copied to clipboard

Challenge: Existing models learn to generate paraphrases by mapping a sequence to another, with each word processed and generated in a uniform way.
Approach: They propose a Transformer-based model that can learn and generate paraphrases at different levels of granularity in a disentangled way.
Outcome: The proposed model achieves competitive in-domain performance compared to state-of-the-art models and significantly better performance when adapting to a new domain.
Controllable Paraphrase Generation for Semantic and Lexical Similarities (2024.lrec-main)

Copied to clipboard

Challenge: Lexically diverse paraphrases are crucial in data augmentation because they enhance the linguistic diversity of the corpus.
Approach: They propose a controllable model for semantic and lexical similarities by attaching tags to the head of the input sentence.
Outcome: The proposed model can paraphrase an input sentence according to the tags specified.
Revisiting Pivot-Based Paraphrase Generation: Language Is Not the Only Optional Pivot (2021.emnlp-main)

Copied to clipboard

Challenge: Existing methods for paraphrase generation rely on language as the pivot . however, there is no evidence that parallel data of paraphrases is needed for paraphrasing.
Approach: They propose to use semantic and syntactic representations as pivot for paraphrase generation.
Outcome: The proposed method can generate paraphrases with better quality than using language as pivot.
IndicNLG Benchmark: Multilingual Datasets for Diverse NLG Tasks in Indic Languages (2022.emnlp-main)

Copied to clipboard

Challenge: IndicNLG is a non-English language that is hampered by the scarcity of datasets.
Approach: They propose to create a dataset for natural language generation for 11 Indic languages . they use a set of pre-trained models to train multilingual models .
Outcome: The proposed datasets show that pre-trained models perform well in multilingual and monolingual tasks.
Learning to Rank Generation with Pairwise Partial Rewards (2023.emnlp-main)

Copied to clipboard

Challenge: Existing methods for conditional text generation suffer from large action space and delayed reward, as the reward can be computed only after an entire sequence is generated.
Approach: They propose a method that provides partial rewards for intermediate actions taken on partial sequences to prioritize actions that lead to the generation of more desirable sequences.
Outcome: The proposed method overcomes the limitations of the prevalent supervised maximum likelihood estimation approach.
Paraphrase Generation: A Survey of the State of the Art (2021.emnlp-main)

Copied to clipboard

Challenge: Using neural models, paraphrase generation research has shifted to neural methods . a recent study focused on paraphrases, which are used in language understanding tasks .
Approach: They propose to use neural methods to generate fluent, diverse paraphrases from a sentence . they propose to combine large pretrained language models with other mechanisms to generate more advanced paraphrase generation models.
Outcome: This paper examines various approaches to paraphrase generation with a main focus on neural methods.
AESOP: Paraphrase Generation with Adaptive Syntactic Control (2021.emnlp-main)

Copied to clipboard

Challenge: Existing models for paraphrase generation use fixed syntactic structures for all input sentences.
Approach: They propose to add syntactical control to a pretrained language model to generate fluent paraphrases using a retrieval-based selection module.
Outcome: The proposed model achieves state-of-the-art on semantic preservation and syntactic conformation on two benchmark datasets with ground-truth syntaktic control from human-annotated exemplars.
Paraphrase Generation with Deep Reinforcement Learning (D18-1)

Copied to clipboard

Challenge: Paraphrase generation is an important but challenging task in natural language processing . traditional symbolic approaches to paraphrase generation include rule-based methods, thesaurus-based approaches and statistical machine translation (SMT)
Approach: They propose a deep reinforcement learning approach to automatic paraphrase generation . they propose supervised learning and reinforcement learning for evaluators .
Outcome: The proposed framework outperforms state-of-the-art methods in paraphrase generation on two datasets.
Data Augmentation with Paraphrase Generation and Entity Extraction for Multimodal Dialogue System (2022.lrec-1)

Copied to clipboard

Challenge: Contextually aware intelligent agents are often required to understand the users and their surroundings in real-time.
Approach: They propose to build a multimodal dialogue system for children learning basic math concepts using limited datasets.
Outcome: The proposed system improves the Natural Language Understanding (NLU) module of a task-oriented SDS pipeline with limited dataset resources.
ParaMac: A General Unsupervised Paraphrase Generation Framework Leveraging Semantic Constraints and Diversifying Mechanisms (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing unsupervised methods for paraphrase generation are weak in semantic equivalence or expression diversity.
Approach: They propose a framework for unsupervised paraphrase generation that employs multi-aspect equivalence constraints and multi-granularity diversifying mechanisms to achieve good semantic equvalence and expressive diversity.
Outcome: The proposed framework achieves 9.1% and 3.3% absolute gains over previous SOTA on Quora and MSCOCO and can improve to 18.0% and 4.6% on GLUE.
Syntactically Robust Training on Partially-Observed Data for Open Information Extraction (2022.findings-emnlp)

Copied to clipboard

Challenge: Open Information Extraction models have shown promising results with sufficient supervision, but the syntactic distribution of training data is partially observable in comparison to the real world.
Approach: They propose a syntactically robust training framework that enables models to be trained on a multi-paraphrase distribution based on diverse paraphrase generation.
Outcome: The proposed framework can be applied to other syntactic partial observable domains.
Neural semi-Markov CRF for Monolingual Word Alignment (2021.acl-long)

Copied to clipboard

Challenge: Experimental results show that our proposed model outperforms all previous approaches for monolingual word alignment.
Approach: They propose a neural semi-Markov CRF alignment model which unifies word and phrase alignments through variable-length spans.
Outcome: The proposed model outperforms existing models on in-domain and out-of-domain evaluations and a QA-based benchmark with human annotations.
Paraphrase Generation by Learning How to Edit from Samples (2020.acl-main)

Copied to clipboard

Challenge: Experimental results show the superiority of our retrieval-based paraphrase generation model in terms of both automatic metrics and human evaluation of relevance, grammaticality, and diversity of generated paraphrases.
Approach: They propose a retrieval-based method for paraphrase generation which uses a novel editor module to extract edits from paraphrase pairs.
Outcome: The proposed model outperforms existing models in automatic metrics and human evaluation of relevance, grammaticality, and diversity of generated paraphrases.
Paraphrase Generation as Unsupervised Machine Translation (2022.coling-1)

Copied to clipboard

Challenge: Existing methods for paraphrase generation rely on labeled datasets or are limited in narrow domains.
Approach: They propose a paradigm for paraphrase generation by treating the task as unsupervised machine translation based on pairs of unlabeled monolingual sentences.
Outcome: The proposed paradigm can generate paraphrases on a large unlabeled monolingual corpus without relying on bilingual sentence pairs.
Negative Lexically Constrained Decoding for Paraphrase Generation (P19-1)

Copied to clipboard

Challenge: Paraphrase generation is a monolingual machine translation problem.
Approach: They propose a neural model that first identifies words in the source sentence that should be paraphrased and then decodes them by negative lexical constraints.
Outcome: The proposed model improves paraphrase generation by making necessary rewrites to an input sentence.
Improving Large-scale Paraphrase Acquisition and Generation (2022.emnlp-main)

Copied to clipboard

Challenge: Existing Twitter-based paraphrase datasets lack quality definitions for identification and generation tasks.
Approach: They propose to use two separate definitions of paraphrase for identification and generation tasks in existing Twitter-based paraphrase datasets.
Outcome: The proposed model achieves state-of-the-art performance of 84.2 F1 for automatic paraphrase identification compared to other models fine-tuned on other corpora such as Quora, MSCOCO, and ParaNMT.
Automatic Compilation of Resources for Academic Writing and Evaluating with Informal Word Identification and Paraphrasing System (2020.lrec-1)

Copied to clipboard

Challenge: a systematic review of academic writing aids aims to build a writing aid system that automatically edits a text to adhere to the academic style of writing.
Approach: They propose to build a writing aid system that automatically edits a text to adhere to the academic style of writing.
Outcome: The proposed system outperforms existing academic resources in terms of word identification and ranking . the informal word identification component achieves an F-1 score of 82% .
Paraphrase Types for Generation and Detection (2023.emnlp-main)

Copied to clipboard

Challenge: Current approaches to paraphrase generation and detection ignore the intricate linguistic properties of language.
Approach: They propose two tasks to consider specific linguistic perturbations at particular text positions.
Outcome: The proposed tasks address the shortcoming of ignoring the linguistic properties of language.
Explicit Syntactic Guidance for Neural Text Generation (2023.acl-long)

Copied to clipboard

Challenge: Existing text generation models follow the sequence-to-sequence paradigm . generative grammar suggests humans generate language by learning language grammar .
Approach: They propose a syntax-guided generation schema that searches the syntax tree in a top-down direction.
Outcome: The proposed method outperforms autoregressive baselines on paraphrase generation and machine translation.
Unifying Discrete and Continuous Representations for Unsupervised Paraphrase Generation (2023.emnlp-main)

Copied to clipboard

Challenge: Existing unsupervised paraphrase generation methods require large-scale, manually annotated paraphrase datasets, which are labor-intensive to build.
Approach: They propose a self-supervised pseudo-data construction method that generates diverse pseudo-paraphrases in distinct surface structures for a given sentence.
Outcome: The proposed method generates diverse pseudo-paraphrases in distinct surface structures for a given sentence.
Vector-Quantized Prompt Learning for Paraphrase Generation (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for paraphrase generation are difficult to understand and generate.
Approach: They propose to generate diverse paraphrases by using instance-dependent prompts to control the generation of pre-trained models.
Outcome: The proposed method achieves state-of-the-art on three benchmark datasets, including Quora, Wikianswers, and MSCOCO.
Self-Ensemble of N-best Generation Hypotheses by Lexically Constrained Decoding (2023.emnlp-main)

Copied to clipboard

Challenge: Existing studies have improved generation quality by explicitly reranking N-best candidates.
Approach: They propose a method that ensembles N-best hypotheses to improve natural language generation by combining high-quality fragments of N- best hypothese . they use tokens that should or should not be present in the final output as lexical constraints to improve quality of generation.
Outcome: Empirical results show that the proposed method outperforms strong N-best reranking methods on paraphrase generation, summarisation, and constrained text generation.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations